View-dependent 3D Projection using Depth-Image-based Head Tracking

The idea of augmenting our physical reality with virtual entities in an unobtrusive, embedded way, i. e., without the necessity of wearing hardware or using expensive display devices is exciting. Due to the development of new inexpensive depth camera systems an implementation of this idea became affordable for everyone. This paper demonstrates an approach to capture and track a head using a depth camera. From its position in space we will calculate a viewdependent 3D projection of a scene which can be projected on walls, on tables, or on any other type of flat surface. Our projector-camera system enables the viewer to explore the projected scene while walking around.